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^ | Abstract 

We study the behaviour of iterations of the difference operator 5 on 
streams over {0, 1}. In particular, we show that a stream cr is eventually 
periodic if and only if the sequence of differences cr, S ( cr) , 6 2 ( cr) , . . ., the '6- 
orbit' of cr as we call it, is eventually periodic. Moreover, we generalise this 
result to operations Sd that sum modulo 2 the elements of each consecutive 
; block of length d + 1 in a given 01 -stream. Some experimentation with 6- 

& orbits of well-known streams reveals a surprising connexion between the 

i ^ i Sierpihski stream and the Mephisto Waltz. 

> 1 Introduction 

In previous work [4, 6, 3] we have been interested in definability of 01 -streams 
I by means of fixed point equations in a certain restricted format (PSF, pure 

stream format), restricted enough to guarantee decidability of productivity, a 
notion of well-definedness. The format PSF was expressive enough to encom- 
pass all automatic sequences [ ]. In the course of those investigations we often 
(~^> employed as illustrations some well-known streams, such as the Thue-Morse 

sequence M, the Toeplitz or period doubling sequence T, the Fibonacci stream F, 
the Sierpihski stream S, and the Mephisto Waltz W. For definitions of these 
streams see Table 1; for more background see [ ]. 

Apart from the expressivity or definability aspect, we also were and are 
very interested in relations between such streams: can we transform one stream 
into another, employing a certain arsenal of transformations — such as e.g. fi- 
nite state transducers (FSTs), or, equivalently, unary contexts in the PSF-format. 

One striking, well-known transformation is that of M into T using the 'first 
difference operator' 6, defined by 6(o~)(n.) = O"(n) + o"(u+1),forall01-streams cr 
and n e N, where + is addition modulo 2, or, in the PSF format: 

6(x:y:cr) -> (x + y) : 6(y : cr) 

and with an equivalent FST as in Figure 1. 
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* An earlier version of this paper appeared in [12]. 
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Figure 1: An FST implementing the 6 operator. 
Now 6(M) = T, as one easily verifies: 

m = on oi oon ooi on oi ooi on ooi ioiooi ... 

T= 1011101010111011101110101011101 ... 

A first question now presents itself: what do we encounter by iterating 6, so 
that we get the '5-orbit' of M: 

M,6(M),6 2 (M),5 3 (M),... 

A visual impression is given by Figure 2. We will prove that this 6-orbit of M is 
not periodic — that is, all streams 6 n (M) are mutually different. 1 

This non-periodicity fact is a corollary of Theorem 10 below stating that the 
5-orbit cr, 6(cr), 6 2 (a), . . . of an arbitrary stream cr 6 {0, 1 } w is eventually peri- 
odic if and only if cr is eventually periodic. We also generalise this periodicity 
theorem to operations 5 a that we call 'd+1 -block difference'; 6 is then the 2- 
block difference &i . 

Next, we observe that the difference matrix with top row M (see Figure 2) 
exhibits ever growing triangles of zeros. It is as if repeated application of 6 
tends to damp out the volatility of the stream M, so that in 6 n (M) ever larger 
stretches of 0's appear. We wondered whether this is a general phenomenon, 
and therefore we determined the 5-orbit of some other streams, starting with 
the Fibonacci stream F, see Figure 6. The result is strikingly different from the 
5-orbit of M: the black triangles now seem uniformly bounded in size. So the 
'damping out' effect that 6 had on M, is by no means general. We also give 
an example showing how significant information can be detected from a con- 
sideration of these 'fingerprint' patterns exhibited by the 5-orbits, displayed as 
matrices as in Figures 2, 3, 6, and 7. Namely, in an experiment it turned out 
(see Figure 7) that the 5-matrix of the Sierpihski stream S and the Mephisto 
Waltz W of Keane [ ] are after the first couple of rows exactly the same! In 

1 In fact, we can give explicit expressions for the iterations of 5 (see [11]): 
6 2n (M) =zip(5 n (M),5 n (M))and6 2n +' (M) = zipfzeros, 6 n+1 (M)). 
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Figure 2: The first 400 iterations of & on the Thue-Morse sequence (top row); Os are 
black, Is are white. 

this we way, by comparing these fingerprints, we found that 

5 2 (S) =6 3 (W) 

a curious fact that seems hard to find or guess otherwise, because S and W 
seem totally unrelated in their definition. 

2 Generalized Difference Operators 

The ' d+ 1 -block difference' 6 d ( a) of a bitstream is the stream obtained by adding 
modulo 2, each block of d + 1 consecutive elements of cr, that is: 

6 d (a)(i) = o-(i) + ■ ■ ■ + a(i + d) 

So we have a 'sliding window' of length d + 1 moving through the stream cr. 

Some preliminary remarks are in order. Let 2 = {0,1}. For a, b £ 2, we write 
a + b for the sum (or difference) of a and b modulo 2, and a for the inverse of 
a defined by a = a + 1 . We use 2 W to denote the set 2 W — {cr | cr : N — > 2} of 
infinite words (streams) over the alphabet 2. 
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Definition 1. For d e N, the operator 5d : 2 W — > 2^ is defined as follows: 

d 

6 d (o-)(i) =^cj(i + j) for all cr e 2 W and i e N. 

j=0 

We call 6d.(c) the d + 1 -block difference of o, and we define 6 to be 6 = 6i . 

The b^-orbit of a stream cr e 2"*, which we denote by T>&{u), is defined as 
the infinite sequence of iterated block differences of cr: 

We write T>{a) for X>! (cr). 

There is a close correspondence between the n-th iteration of 6 and the tri- 
angle of Pascal: 

6 n (<r)(i) = £ (?Y cr(i + k) (1) 

k=0 ^ ' 

A quick hint for this is obtained by inspecting the 6-orbit of a stream X p which 
is everywhere except at position p; so let X p e 2^ be defined by 

X p (p) = 1 and X p (n)=0 ifn^p. 

Figure 3 pictures the p xp-cut of the 5-orbit 2?(X p _i ), for p = 2 9 . Not displayed 




Figure 3: A 512x512-CMf o/ t/ie 5-orfczf P(X 511 ). 
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is the infinite darkness to the right. Vertically the figure repeats itself, as we 
explain below. We clearly find back, though somewhat slanted, the Sierpihski 
triangle, which is the limit, as the number of rows approaches infinity, of Pas- 
cal's triangle modulo 2. The last row 6 P_1 (X p _i ) in Figure 3 consists of p ones 
(followed by infinitely many zeros), and so the first row not in the picture will 
be equal to X p _i (top-row) again. Hence, the period of this 6-orbit is p. 

To obtain a more general result for 6 d similar to (1), we use a generalisation 
of Pascal's triangle. First we recall the recursion equation for (Vj, the entry at 
row n, column k of Pascal's triangle: 

;MVMr; 

adding up the values in columns k and k — 1 of the previous row n — 1 . In 
triangles A d defined below, with d € N, the value A d (n, k) at row n, column k 
isthesum/\ d (n,k) = A d (n- 1,k) + A d (n- 1 ,k- 1) + • • • + A d (n- 1,k- d). 

Definition 2. Let d G N. We define triangle /\ d :NxZ^Nas follows: 



A(n,k) =Y_ /\(n-1,k-i) (0 < k < dn,n > 0) 

d i=0 d 

A(n,k)=0 (k < or k> dn) 

d 

and we write A d ( n ) ror the n-th row of triangle A d / that is, for the sequence: 
/\(n)=/\(n,0), ... ,/\(n,dn) 

d d d 

Note that triangle Ai is the usual Pascal triangle: 

As an example, the first couple of rows of triangle /\ 2 are shown in Figure 4. 

Remark 3. Perhaps a cleaner, but notationally heavier, definition of Ad( n ' k ) 
is to define it only for values < k < dn, as follows: 

min( d,k) 

A( n > k )= Z A( n - 1 - k -^ («) 

d i=max(0,k— d(n— 1 )) d 

so that the summation is only over the non-zero (defined) values of the previ- 
ous row, as we have < k— i < d(n— 1 ) due to the range of the index variable i. 
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Figure 4: Triangle /\ 2 . 



The sum in (;) is easily seen to be equal to the sum Y.i=o Ad( n ~ 1 , k — i) of 
Definition 2: in the latter we allow the variable i to also go through the values 
smaller than k — d(n — 1 ), and values greater than k. This does not change the 
outcome, because for these values of i we get that k— i > d(n — 1 ), and k— i < 0, 
respectively, and thus Ad( n — ^ > ^ — ^ = by definition of /\ d . 

In the area of combinatorial mathematics Pascal's triangle has been gener- 
alised in the way we do here, e.g. in [ ], where Ad( n > ^) means (our notation): 

Ad( n > is the number of distinct ways in which k indistinguishable ob- 
jects can be distributed in n cells allowing at most d objects per cell. [8] 

Alternatively, one can view a triangle /\ d as a graph = (V d , E d ) where: 

V d = { (n,k) | n G N, < k < dn} 
E d ={((n ) k),(n+1,k + j)) |0< j < d} 

Then the value Ad( n > ^) is the number of paths from (0,0), the root of G^, to 
the vertex (n, k). 

The following fact about double summations will be encountered several 
times in the sequel. For all x : N x N — > N, and p , q € N: 

p 1 P + q min(p,k) 

Hx(iJ)- Z X(i,lc-i) (II) 

i=0 j=0 k=0 i=max(0,k-q) 

See for instance the proof of Lemma 5, where (II) is used to move a subexpres- 
sion of x which only contains index variable j, out of the scope of the summa- 
tion that binds variable i. 

The following lemma generalises a familiar property of Pascal's triangle, 
namely that the sum of values in the n-th row equals 2 n . 

Lemma 4. 

dn 

^/\(n,k) = d n 

k=0 d 
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Proof. By induction on n. The case n = is trivial, as we have that /\ d (0, 0) = 1 
by definition. If n = n' + 1 we reason as follows: 

dn dn' + d min(d,k) 

k=0 d k=0 i=max(0,k-dn') d 

d dn' 

= ZZA( n '>^ 

i=0 j=0 d 
dn' 

j=0 d 

= d • d n ' (IH) 

□ 

We are ready for the generalisation of (1) on page 4. The triangle /\ d (mod- 
ulo 2) can be used to relate the n-th block difference 5 d ( a) to the original stream 
a, as follows: 

Lemma 5. 

dn 

5S(a)(i) = £ /\(n,k).a(i + lc) 

k=0 d 

Proof. By induction on n. For n = the statement directly follows by unfolding 
definitions. In case n = v! + 1, we reason as follows: 

65(a)(1) = 6 d (fiS'(<r))(i) 

d 

j=o 

d dn' 

= ^^/\(n',k)-cj(i + j + k) (IH) 

j=0 k=0 d 
dn min(d,£) 

= Y_ Y. /\{n',l-])-c(i + l) (II) 

1=0 j=max(0,£-dn') d 
dn d 

£=0j=0 d 
dn d 

= L(ZA( n '> £ -5)) -a(i + «) 

{=0 j=0 d 
dn 

= ^/\(n,£)-a(i + £) 

«=0 d 

□ 
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3 Periodic Orbits 

In this section we show that the 5-orbit T)& ( cr) of a bitstream cr <E 2 W is eventu- 
ally periodic if and only if the stream cr itself is eventually periodic. 

As an instance of Lemma 5 we obtain that by taking /\ 2 in Figure 4 we 
derive how the values of b\ are related to those of the original cr, as follows: 

6£ (i) = 1 ■ cr(i)+4-cr(i+1) + 10-a(i + 2) + 16 ■ a(i + 3) + 19- cr(i + 4) 
+ 1 6 ■ cr(i + 5) + 1 • ff(i + 6) + 4 ■ cx(i + 7) + 1 • cr(i + 8) 
= cr(i) + cr(i + 4)+cr(i + 8) 

as only for k = 0,4,8 the entries /\ 2 (4,k) are odd. For iterations which are 
powers of 2 this can be generalised, because, for n = 2 m , the n-th row of a 
triangle /\ d modulo 2 always has the following shape: 



that is, d + 1 many Is with blocks n in between them. This observation, 
translated to 6-orbits in the following lemma, is crucial for the main result of 
this paper, Theorem 10, for it enables us to pinpoint the periodicity in the orbit 
by looking at rows 2 m with 2 m = (mod p), with p the period of cr. 

Lemma 6. For n a power of 2, we have: 



Proof. Let n = 2 m . The proof proceeds by induction on m. The base case m = 
follows directly by definition of 6 If m = m' + 1, we let n' = 2 m andweinfer: 




= 2 



d 



d 



63((r)(i)=63(6S(ff))(i) 



d 




(IH) 



j=0 



d 



d 




(IH) 



j=0 k=0 



2d 



min(d,{) 






(21) 



£=0 j=max(0,f-d) 



2d 



min(d,«) 




«=0 j=max(0,£-d) 
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Let us abbreviate the subexpression X.f=laxio ^ by ^W- ^ or both ^ — ^ 
and £ > d we have that S(i) — i + 1, and hence we can continue as follows: 

2d 

= ^S(£) • a[i + t-n') 

d d-1 

= Y_ s ( 2£ ) ' + 11 ■ n ') + X S(2£ + 1) • + (2« + 1) • n') 

d d-1 

= ^ 1 • a(i + 2£ • u') + ^ • a(i + (2£ + 1) • n') 

d 

Thus, we have shown, torn = 2 m , the equality 6£(cr)(i) = 2^f=o o"(i+l!-TL). □ 

For d = 1, Lemma 6 gives 6 n (cr)(i) = cr(i) + cr(i + n), for n = 2 m . Indeed, 
for n = 2 m all (£) for 1 < k < n — 1 are even, and this in turn follows from the 
fact that all rows /\ 1 (n) with n = 2 m — 1 consist of odd numbers only. From 
the latter observation we also obtain: 

Lemma 7. Ifn = 2 m — 1 for some me N, then 6 n = 6 n . 

Proof. For all m,u e N, we prove that if n = 2 m — 1 then 6 n (u)(i) = 6 u (a)(i), 
for all cr g 2 W and i e N, by induction on m. If m = 0, then n = and we have 
6°(cr) = a = 5 (a). If m = m' + 1, then n = 2n' + 1 with n' = 2 m ' - 1, and we 
reason as follows: 

5 n ((r)(i) =6(6 n '(6 n '(cT)))(i) 

= 6-'(5-'(cr))(i) + 5 n '(5 n '(cT))(i+l) 

= MMoOKi) + 5n,(S n ,(a))(i+ 1) (4 x IH) 

= S^(a)(i) + 6^(o-)(i+l) 

vl ri 

= ^cr(i + 2i) + ^o-(i + 2j + l) (2 x Lemma 6) 

j=o j=o 

2n' + l 

j=0 
= 5n(ff)(i) 

□ 

Definition 8. Let A ^ 0. A sequence cr e A w is (eventually) periodic if there 
exist p > 1 and no € N such that (Vn > no)(c(n + p) = c(n)), where we call 
p the period, and no the offset of a. For a function f : A w — > A 1 ", we say that f 
strongly preserves periodicity if f (a) has the same period and offset as cr. 
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In other words, cr is eventually periodic if and only if there exist p > 1 
and no G N such that for all ni ,ri2 > no with ni = n2 (mod p) we have 
ff(ni ) = cr(ri2). Note that we do not require p and no to be minimal. 

Let us drop the adjective 'eventual' and take 'periodic' to mean 'eventually 
periodic'. 

Lemma 9. The difference operator 6 a strongly preserves periodicity. 

Proof. Let cr G 2 W be a periodic stream with period p e N and offset no 6 N. 
Then it immediately follows that: 

d d 

6 d (ff)(n + p) =^o-(n + p+j) = ^cr(n + j) =5 d (a)(n) 

j=0 j=0 

for all n > no, and hence 6<i(cr) is periodic with period p and offset no. □ 

By linearity of 6 a we obtain that all SJf 1 strongly preserve periodicity. 

We come to the main theorem of our contribution, roughly stating that hor- 
izontal periodicity of a 6-orbit implies vertical periodicity, and vice versa. 

Theorem 10. Let d <E N. A stream cr g 2 W is periodic if and only ifV&{o) is periodic. 

Proof. Let d € N. We prove both implications separately. 

(only if) Let cr be a periodic stream with period p and offset no. Furthermore, let 
N i = 2 m ' and N 2 = 2 m2 for some mi , m.2 € N such that n < N 1 < N 2 
and N i = N2 (mod p) (these are bound to exist, as there are finitely many 
equivalence classes {m | m = n(mod p)} and infinitely many powers 
of 2). Then, by Lemma 6 and periodicity of cr, we find: 

d d 

§d ' (cr)(n) = Y_ <r(n + jN, ) = ^ + 3 N 2) = 6 d 2 (ff)(n) 

j=0 j=0 

for all n > no, and hence 2?a(cr) is periodic. 

(f/) Let ©dlcr) be periodic with period p and offset n , i.e., — 6^ +p (cr), 

for all n > n . Again, let Ni = 2 mi and N 2 = 2 m2 for some mi , m.2 € N 
such that no < Ni < N2 and Ni = N2 (mod p). Then we have, for 
all i e N, 6^' (cr)(i) = 6^ 2 (cr)(i). From Lemma 6 it then follows that 
L, d =o ff ( i + i N 1 ) = L, d =o ^t 1 + J N 2)- Hence, we obtain, still for all i e N: 

d d-l 

cr(i+dN 2 ) =^ff(i + jN,) + ^cr(i + iN 2 ) 

5=0 j=o 

In other words, the element cr(i + dN2) is uniquely determined by the 
dN2 preceding elements of cr. We conclude by observing that there are 
only finitely many blocks of length dN2, and hence there must come a 
repetition: i.e. we find dN2 < ii < ii such that cr(ii + n) = cr(i.2 + n), for 
all n € N. Hence cr is periodic. □ 
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4 The 6-orbits of some non-periodic streams: 
Fibonacci, Mephisto, Sierpinski 

We define some non-periodic streams and look at their 6-orbits. In Table 1 we 



M = : zip 1 j (inv(M), tail(M)) 
zip n m (ff,T) =take(n, a) :zip m n (T,tail n (cT)) 

tail (cr) = cr 
inv(0 : cr) = 1 : inv(cr) 
inv(1 : cr) = : inv(cr) 

T = zip 3 ^(wt.T) 
W T = 1 : : 1 : W T 

W = h w (0:tail(W)) 

h w (0:cr) =0:0:1 :h w (cr) 
h w (l :u) = 1 :1 :0:h w (cr) 

S = zip 81 (w s ,S) 
w s = 1:1:0:0:0:0:1:1: inv(w s ) 

F = h F (1 :tail(F)) 
h F (l :u) = 1 :0:h F (c>) 
h F (0:cr) = l:h F (cr) 



Table 1: Stream specifications. 

give PSF specifications of the Thue-Morse sequence M, the period doubling 
sequence T, the Fibonacci word F, the Mephisto Waltz W, and the stream S 
which we call the Sierpinski stream. (Of course, alternative specifications exist.) 

As far as we know, the Sierpinski stream does not occur in the literature. 
We have derived it from the construction of the 'Sierpinski arrowhead curve', 
see Figure 5. The curve is obtained back from the stream S by interpreting 




Figure 5: Construction of the Sierpinski arrowhead curve. 
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its entries S = 110000111 001111001 110000110001111000110000110 ... as tur- 
tle drawing instructions: 1 means move forward one unit length and turn to 
the left tc/3, and means move forward one unit length and turn to the right 
7t/3. In this way, the Sierpiriski curve arises as the Hausdorff limit of the finite 
approximations (scaling back in size when necessary). 

Theorem 10 implies that any stream cr which is equal to one of its differences 
6^(cr) is periodic. Put differently no two differences of a non-periodic stream, 
e.g. the Thue-Morse sequence M, are the same. The 6-orbit of M is depicted 
in Figure 2. Observe that subsequences of consecutive 0s become larger and 
larger. 

We do not see this 'calming down' aspect in Figure 6, which displays the 




Figure 6: The first 400 differences of the Fibonacci stream. 

5-orbit of the Fibonacci stream that can be defined as the fixed point of the 
substitution — > 1,1 — > 1 starting on 1 . 

One more experiment with 6-orbits is shown in Figure 7, where the 6-orbits 
of the Sierpihski stream S and the Mephisto Waltz W are displayed. It is read- 
ily seen that both patterns seem identical, from the distribution of the black 
triangles. That they are indeed identical is revealed by a closer inspection of 
the first couple of rows; it turns out that the third row of the left orbit, i.e. 5 2 (S), 
is identical to the fourth row of the right orbit, i.e. 6 3 (W). Indeed, the 16x 16 
enlargements show at these row-positions both the prefix 1 1 001 1 01 1 1 1 001 1 1 of 
length 16. 
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Figure 7: Comparing the 'fingerprints' T>(S) and 2?(W) of the Sierpinski stream S 
(left), and theMephisto Waltz W. We find that 6 2 (S) = 5 3 (W)/ 

5 Concluding Remarks 

(i) An interesting specific question is whether the dynamical system with as 
universe the 01 -streams and 6 as iterator function, is chaotic — such as the 
dynamical system of 01 -streams with 'tail' or 'shift' is, as is well-known; 
see e.g. [ , p. 118, Coroll. 11.22] or [ ]. To this end it suffices to show that 
the set of points (streams) periodical under 6 are dense in the set of all 
streams, and second that there exists a stream whose 6-orbit lies dense 
in the set of all streams, thus ensuring the topological transitivity of the 
iterator function 6. The third ingredient necessary for 6 to be chaotic, 
namely sensitive dependence on initial conditions, seems clearly to be 
the case. 

(ii) In general it would be interesting to investigate typical questions in sym- 
bolic dynamics (see, e.g., [ ]) for the dynamical systems formed by infinite 
streams, equipped with continuous stream functions that are PSF- or FST- 
definable. 

(iii) Note that the tail-orbit starting with M exhibits the phenomenon of almost 
periodicity: in the usual metric on infinite streams, tail n (M) can be made 
arbitrarily close to M, by choosing n large enough. The proof is simple. 

Also the orbit 2?2 (M) seems to be almost periodic. 
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(iv) The observation in (iii) leads to the following question: for which FST- 
definable operations and which starting streams is the orbit almost peri- 
odic? 
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